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ABSTRACT 

This paper addresses the problem of finding super-efficient estimators for single parameter families. Initially, the 
original approach of Hodges (1951) is presented. A procedure for obtaining super-efficient estimators with respect to 
'Fisher Information’, using the ’Delta Method’ of asymptotic inference theory is derived and illustrated with examples. 
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1. INTRODUCTION 


Let X l ,X 2 ,'",X n be i.i.d. 
p(x I 0), xeS (^R k ,0e£l(^R . Let l g 


k-dimensional 


d log p(x I 6 ) 

Ye 


vector-valued random variables, each 
be the score function and let 1(8) =E (l g ) 


with p.d.f. 
be the Fisher 


Information (FI). 

Denoting X (n) = ( X x , X 2 , • • • , X n ), let T n (X(ni) = T (say) be any unbiased estimator of 8, Ve(T) be the variance of 
T and C be the class of unbiased estimators of 6. Then, by Cramer-Rao Inequality, 


Ve(T) > 


— - — , VTe C 
n 1(0) 


( 1 . 1 ) 


Let °,A X (n)) = e n (say) be any estimator (not necessarily unbiased) of 9. It could be MLE of 9 or any other. In 
view of the inequality (1.1), 0 n is said to be ’Asymptotically Efficient’ (AE) if 

Yn(0„-0) 4a(0,/ _1 (^)), 0e £1 


An estimator 6 n of 9 is said to be ’Super Efficient at 9 g ' if 

Yn(0„-e ) 4/V(O,er(0)), 0e a 

where I 1 (0) > <J 2 (0) V 0£. £1 and I l (0 o ) > (7 ~ ( 0 O ) for some 0 q eQ,. 
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Hodges (1951), in an unpublished work, was the first to propose super efficient estimator. For detailed discussion 
on Hodge's super efficiency, reference is made to Bahadur (1983). Investigations were carried out and interesting results on 
the principle of super-efficiency were established by Le Cam (1953, 1956, 1960, 1972). Basu (1952) considered the non- 
regular Uniform family lit 7, 2(9) and established the super-efficiency of the Best Linear Unbiased Estimator over the 
unbiased estimator based on the MLE of 0. Stein (1956) discussed super efficient estimator of a multivariate normal mean 
vector with the squared-norm loss function. Sethuraman (2004) carried out interesting investigations on the efficiency of 
tests based on super-efficient estimators comparing it with tests based on the MLEs. Durairajan (2012) presented the notion 
of Sub-Score and construction of Super-efficient estimator for estimating a vector parameter of interest in the presence of 
nuisance parameters. 

This paper is organized as follows: Section 2 discusses the idea of Hodges (1951) that led to the notion of 'super- 
efficiency'. In Section 3, the 'delta method' of asymptotic inference theory is invoked to obtain super-efficient estimators 
for single parameter families of distributions. Section 4 presents a few applications of the method to obtain super-efficient 
estimators in different contexts. 


2. THE IDEA OF HODGES (1951) 


Let 0 n be the maximum likelihood estimator of (9 such that yfn (0 n - 0) -» N(O,I~ l (0 )), 0 e C2.Let0 o be 
an arbitrary value of (9. Consider the estimator 


0 „ 


I 00 if n 114 \0 n —0 o \<i 

\0 n if n v 4 \e n -e t) \>\ 


( 2 . 1 ) 


Clearly, [ 0 n ~t- 0 \ => \0 n = 0 {) ]. Note that this is a one-way implication only. 

So, P e [ 0 n ±0 n ]< Pet 0„ = 6> 0 ] = Pe [ n' 4 \0 n ~0 Q \< 1] (2.2) 


Consider I 0 — 0 t) I < I 0 n — 0 I + I 0 n — 0 Q I from which we get 


\ 0 n -0 \>\ 0 - 0 o \-\ 0 n - 0 o \ 

Thus, [ n 1 /4 1 0 n — 0 {) I < 1 ] => \ \0 n —0 I > 1 0 — 0 Q I - n 14 ] so that 

P e [n 1/4 \0 n -0 O \ < 1] < Pe[\0„~0 I > \0~0 O \ -n~ U4 ] (2.3) 

Using (2.3) in (2.2), we get 

Pe[0„*0J < Pe[yfn\0„-0 I > 4n \0~0 o \-n V4 ] (2.4) 


We now investigate the asymptotic behaviour of 0 n . 

For 6 ± 0 O , yfn \0 — 0 o \ - n 1 14 — ■> so, P 9 [ *Jn 1 0 n — 0 I > yfn \ 0 — 0 Q \ -/7 1/4 ] — >0 as n — > , which 
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in turn gives P e [ Q n 0 ■ That is ’ 9 n and are asymptotically equivalent and have the same asymptotic 

behaviour. Hence, we infer that 

yfn (§ n -0) — »/V(0, / '* (i 9 ) ) for 0 # d 0 (2.5) 

And, for 6 = 0 o , by the definition of 6 n , P 0O [ 6 n = 0 {) \ = P 0O [ n' A I G n — 0 O I < 1] 

That is, P 0O [ 4n (0 n - 0 O ) = 0 ] = P 0O [ 4n \ 9 n -6 0 I < n U4 ] 

= P 0O [-/7 1/4 < Jn\e n -9 0 \<n 114 ] 

— > 1 as n — > oo 

Hence, we infer that, <Jn(6 n -0 o )->N(O,O)for0 = 0o (2.6) 

From (2.5) and (2.6), it is found that asymptotic variance of 6 equals that of 6 n for 0 ^ 9 0 and is less (equal to 
0) for 0 = 9 0 - Hence, 0 n defined in (2.1) is 'super efficient' at d 0 . 

3. DELTA-METHOD TO GET SUPER-EFFICIENT ESTIMATORS 

Let T n be a statistic that is asymptotically normal about parameter 0. That is, suppose we have yfn (T n - 0) — > 
N(0, o 2 (0) ). Consider a statistic g(T n ) where ‘g’ is a function that is at least twice differentiable at 0. Expanding the 
function g(t) in a neighbourhood of 0, to the first degree of approximation, we have 

g(T n ) ~ g(0) + (T n - 0) g'(0) 

so that -47l [ g(T n ) - g(0) ] ~yfn (T n - 0) g'(0) -»N(O,[g'(0)]V(0)) (3.1) 

In other words, g(T n ) is approximately normal about g(0) with variance [g'(0)] 2 o 2 (0) / n. 

We now present a result which helps obtain super-efficient estimator using the delta method. 

Theorem 3.1: Let g: Cl — > Cl be a function and let d 0 be a point in the space Q such that g( d 0 ) = d 0 and 'g' is 
differentiable at d 0 with Ig \Q 0 ) I < 1. If 0 n be asymptotically efficient estimator of d, then the estimator 


I’M) if n m \e,-e a \<\ 

\e„ $ n m \e.-0v i>i 


is super-efficient at d 0 . 

Proof: Given 0 n is asymptotically efficient for d, we get 


(3.2) 
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4n{0„ -0) — >iV(0,/ _1 (#)) , 6 £ Q. (3.3) 

Applying the delta method to the point 9 0 , we get 

Mg0 n )-o . 0 )] ^Nmg\e 0 )fr\e,)) ( 3 . 4 ) 

Let A n = [ n 1 l4 w n -0 Q \ < 1], Following the discussion in Section 2, we find that P flo (A n ) — > land Pe(A n ) 
— > 0 for 9^ 9 0 . 

Now, 6 n = 0 n I K + g(6 n ) I A and hence, *Jn (0 n -0) = 4n (0 n -0) I ^ + yfn (g(0 n ) ~0) I A 

For 0 ± 0i h the second term above approaches zero as n — > , while for 8 = 8 0 , the first term approaches zero as 

n — > oo and hence, we have 


Me n -0) 


d 

-> 


| N(o,r l m if 0±0 O 

[^(O.Ig'^o)] 2 ^" 1 ^)) e =°o 


Since, Ig '(do) I < 1, we conclude that 0 is super-efficient at 8 0 . 

The above result, suggests a convenient procedure to obtain super-efficient estimator at a point of the paramter 
space by suitably choosing a function 'g' on the space. Essentially, the requirements on 'g' are 

g m = 9o and Ig \8 0 ) I < 1 (3.5) 

As a generic example, we can have 

g 19) = a l (0-0 o )+a 2 (0-0 o ) 2 +■ ■ ■ + a m (0-0 o ) m + 0 O , 0 e Q. (3.6) 

where 0 o e£l is a chosen point and | a l | <1. However, to illustrate the possibility of specific choices in various 
contexts, a few illustrative examples are presented in the next section. 

4. APPLICATIONS 

4.1 Mean of a Normal Distribution with Known Variance 


Let X|, X 2 , . . . , X n be i.i.d. N (9, 1), 0E R. Consider g (9) = Q L , 0E R, where c > 1 is any known positive 
integer. We have g(0 ) = 0 and g'(0 ) = 0 satisfying (3.5). 

X is UMVUE of 8 with V g (x) = 1 / n = 7 _1 (0) 

Define 


0 = < 

X if yfn 

X 

n 

X if 4n 

X 
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Then, 



MiG, 0 ) for 0 = 0 
N( 0, I~\0)) for 9* 0 


Showing that 9 is super-efficient at 0. 

If we wish to have non-degenerate normal at 9 = 9 0 , choose g(9 ) = c sin {0-0 o )+0 Q ,0eR where I c I < 1 
and 9 0 is any fixed number, or choose g(0 ) as in (3.6). 

4.2 Variance of a Normal Distribution with Known Mean 

Let X b X 2 , . . . , X n be i.i.d. N(0, 9), 9 > 0. Consider g(0) = 0 d , 9 > 0 , where 0 < d < 1 is any known number. 
We have g(l) = 1 and g'( 1 ) = d satisfying (3.5). 

n n 

S 2 = Yj X ? / n is the MLE of 6 with /n) = 26 2/n = I~ l (0) 

i=l i = 1 


Define 


9 


n 


0 S 2 Y if 4n 
S 2 if in 


S 2 -1 < n 114 
S 2 - 1 >n V4 


Then, 



(V(0, d 2 r'( 1)) for 0=1 
n(o,I~\ 0)) for 0*1 


Showing that 9 is super-efficient at 1 . 


4.3 Poisson Parameter 

Let Xi, X 2 , . . . , X n be i.i.d. Poisson(0), 9 > 0. Consider the same g{9) as in Illustration 4.2. 
X is MLE of 9 with V g {x^] = 9 1 n = I 1 ( 9 ) . 

Define 



1 

X if -Jn 

X -1 

On = ' 

X if in 

Y - 1 


Then, 



N{ 0, d 2 I~\ 1)) for 9=1 
N(0,r\9)) for 9*1 


Showing that 9 n is super-efficient at 1 . 
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4.4 Binomial Parameter 

Let X h X 2 , . . . , X n be i.i.d. Bernoulli (1, p), 0 < p < 1. Consider g (p) = 2p(l- p), 0 <p < 1. We have g(l/2) = 1/2 
and g'( 1/2) = 0 satisfying (3.5). 

n 

p n = ^ X i In, is the MLE of 'p' with V p ( p)= p(l- p) / n = I 1 ( p ) 

i = 1 


Define 


Pn = 


2 P„0--Pn) if yfri\p„-l/2\<n 
Pn if Vn \p n - 1/2 1 > n 


1/4 

1/4 


Then, 4n(p n ~p ) 


— > 


N(0,0) for p = l/2 
n{o, I~ l (p ) ) for p ± 1/2 


Which shows that p n is super-efficient at 1/2. 

4.5 Exponential Parameter 

Let X lf X 2 , .... X n be i.i.d. exponential variates with density f 0 (x) = (1 Id) exp(- x/ 9), 6 > 0. Let 6 0 be any 
specified value of 6 and consider g (9) = ( 9+9 0 ) / 2. Clearly, g (9 0 ) = 9 0 and g'(<9 0 ) = 1/2 satisfying (3.5). 


X is MLE of 9 with V e (x ) = 0 2 / n = / 1 (0) 


Define 


e„ = 


(X +0 q )/2 if 4n 

X -0, 

X if -J~n 

x-o. 


< n 


1/4 


> n 


1/4 


Then, Me,-e) 


d 


/V(0, /- 1 (^ 0 )/4) /or 0 = 0 Q 
n(q, r\d)) for 0*9, 


Which shows 0 is super-efficient at 9 0 . 

5. CONCLUDING REMARKS 

The foregoing discussion presents an approach towards construction of super-efficient estimators using the delta 
method of asymptotic inference in single parameter situations. The delta method of asymptotic inference has provided a 
convenient way of constructing super-efficient estimators. Numerical investigations on the estimators proposed in the 
illustrative examples of Section 4 are at a preliminary stage of investigation. Other applications of this approach are also 
being addressed separately. The outcomes of these ongoing research work will be reported in future communications. 
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